🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-14 🟡

🔹 Automate Gov Tender Scraping
👤 Client: 🇦🇺 Sydney, Australia Member since 2026-04-13
💰 Price: $882 Average bid
🚩 Problem: Manual process of discovering and retrieving government tender documents is time-consuming and error-prone.
📦 Existing: Not specified

Specifications:

[Target] Scrape 9 Australian Government tender websites daily for newly published tenders in two specific categories (UNSPSC 43000000 - IT, and 81000000 - Engineering/Research).
[Method] Use Python with Playwright for web scraping and automation.
[UI/UX] Not applicable as this is a backend task.
[Stack] Python, Playwright, Selenium (if needed), Google Sheets API, Google Drive API, Cloudflare bypass techniques.
[Security] Secure handling of login credentials using environment variables or encrypted storage. Implement rate limiting to avoid detection by anti-scraping mechanisms.
[Format] JSON for structured data extraction and insertion into Google Sheet.

Workflow:

1. Set up a Python environment with necessary libraries (Playwright, Selenium, Google Sheets API).
2. Define the URLs of the target websites (AusTender, BuyNSW, Tenders VIC, etc.).
3. Implement login functionality using Playwright or Selenium to handle authentication.
4. Develop scraping logic for each website category (IT and Engineering/Research) to extract key details (Title, Agency, Closing Date, URL).
5. Integrate Google Sheets API to insert extracted data into a centralized Google Sheet.
6. Implement document download functionality using Playwright or Selenium to save documents in uniquely named folders on Google Drive.
7. Schedule the workflow daily via a cron job or task scheduler.